V. ANANTHA NATARAJAN et al: MODELING OF 3D HUMAN FACE FOR TAMIL VISUAL SPEECH SYNTHESIS

نویسندگان

  • V. Anantha Natarajan
  • S. Jothilakshmi
چکیده

The visual equivalent of human face exhibiting articulatory expression of a unit of sound in spoken language is termed as Viseme. The Visemes can be used to teach hearing impaired students visually and effectively. In this paper a method to construct three dimensional human faces from a single 2D image is proposed. By this method a generic 3D mesh of human face is deformed using the calculated feature points from 2D images. The method consists of the following steps namely locate corresponding feature vertices in both 2D image and the generic 3D mesh, calculating the corresponding 3D co-ordinates of the 2D feature points and relative camera position and finally deforming the generic 3D mesh using the Radial Basis Function (RBF) based interpolation. Later the constructed three dimensional models can be animated by morphing different visemes together. The inner articulatory organs are modelled using Java3D and blended with these constructed 3D dimensional units.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Adaptive Man-machine Interfaces

In this project we aim to achieve two significant extensions of our recent work on developing a text-to-visualspeech (TTVS) system (Ezzat, 1998). The existing synthesis module may be trained to generate image sequences of a real human face synchronized to a text-to-speech system, starting from just a few real images of the person to be simulated. We proposed 1) to extend the system to use morph...

متن کامل

Visual speech synthesis from 3D video

Data-driven approaches to 2D facial animation from video have achieved highly realistic results. In this paper we introduce a process for visual speech synthesis from 3D video capture to reproduce the dynamics of 3D face shape and appearance. Animation from real speech is performed by path optimisation over a graph representation of phonetically segmented captured 3D video. A novel similarity m...

متن کامل

Realistic Face Animation for a Czech Talking Head

This paper is focused on improving visual Czech speech synthesis. Our aim was the design of a highly natural and realistic talking head with a realistic 3D face model, improved co-articulation, and a realistic model of inner articulatory organs (teeth, the tongue and the palate). Besides very good articulation our aim was also expression of the mimic and emotions of the talking head. The intell...

متن کامل

Synthesis of human facial expressions based on the distribution of elastic force applied by control points

Facial expressions play an essential role in delivering emotions. Thus facial expression synthesis gain interests in many fields such as computer vision and graphics. Facial actions are generated by contraction and relaxation of the muscles innervated by facial nerves. The combination of those muscle motions is numerous. therefore, facial expressions are often person specific. But in general, f...

متن کامل

Chapter VIII Modeling and Synthesis of Realistic Visual Speech in 3 D

The problem of realistic face animation is a difficult one. This is hampering a further breakthrough of some high-tech domains, such as special effects in the movies, the use of 3D face models in communications, the use of avatars and likenesses in virtual reality, and the production of games with more subtle scenarios. This work attempts to improve on the current stateof-the-art in face animat...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2015